Hybrid Models

The most common strategy for constructing hybrid models:

• a simple (usually linear) learning algorithm followed by a complex, non-linear learner like GBDTs or a deep neural net
• the simple model typically designed as a "helper" for the powerful algorithm that follows